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Abstract. Integrating different knowledge representation languages is 
clearly an important topic. This allows, for instance, for a unified repre- 
sentation of knowledge coming from different sources, each source using 
one of the integrated languages for its knowledge representation. This is 
of special importance for QSR 1 languages, for such a language makes only 
a finite number of distinctions: integrating QSR languages may be looked 
at as an answer to the well-known poverty conjecture. With these con- 
siderations in mind, we consider the integration of Frank's cone-shaped 
and projection-based calculi of cardinal direction relations, well-known 
in QSR. The more general, integrating language we consider is based 
on convex constraints of the qualitative form r(x,y), r being a cone- 
shaped or projection-based cardinal direction atomic relation, or of the 
quantitative form (a, /3)(x,y), with a, /3 G [0, 27r) and (/3 — a) 6 [0,7r]: 
the meaning of the quantitative constraint, in particular, is that point 
x belongs to the (convex) cone-shaped area rooted at y, and bounded 
by angles a and j3. The general form of a constraint is a disjunction of 
the form [n V • • • V r ni V (ai,/?i) V ■ ■ ■ V (a„ 2 , f3„ 2 )](x, y), with r t (x,y), 
i — 1 . . .rii, and (en, /3i)(x, y), i — 1 . . .72.2, being convex constraints as 
described above: the meaning of such a general constraint is that, for 
some i — l...m, ri(x,y) holds, or, for some i = I...712, [on, Pi)(x,y) 

* TCSPs stands for Temporal Constraint Satisfaction Problems, a well-known 
constraint-based temporal framework [S]. 
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holds. A conjunction of such general constraints is a TCSP-like CSP, 
which we will refer to as an SCSP (Spatial Constraint Satisfaction Prob- 
lem). An effective solution search algorithm for an SCSP will be de- 
scribed, which uses (1) constraint propagation, based on a composition 
operation to be defined, as the filtering method during the search, and (2) 
the Simplex algorithm, guaranteeing completeness, at the leaves of the 
search tree. The approach is particularly suited for large-scale high-level 
vision, such as, e.g., satellite-like surveillance of a geographic area. 

1 Introduction 

Knowledge representation (KR) systems allowing for the representa- 
tion of both qualitative knowledge and quantitative knowledge are 
more than needed by modern applications, which, depending on the 
level of detail of the knowledge to be represented, may feel happy 
with a high-level, qualitative language, or need to use a low-level, 
quantitative language. Qualitative languages suffer from what For- 
bus et al. [§| refer to as the poverty conjecture (which corresponds 
more or less to Habel's argument that such languages suffer from 
not having "the ability to refine discrete structures if necessary"), 
but have the advantage of bahaving computationally better. On the 
other hand, quantitative languages do not suffer from the poverty 
conjecture, but have a slow computatinal behaviour. Thus, such a 
KR system will feel happier when the knowledge at hand can be rep- 
resented in a purely qualitative way, for it can then get rid of heavy 
numeric calculations, and restrict its computations to symbols ma- 
nipulation, consisting, in the case of constraint-based languages in 
the style of the Region- Connect ion Calculus RCC-8 [21J, mainly in 
computing a closure under a composition table. 

An important question raised by the above discussion is clearly 
how to augment the chances of a qualitative/quantitative KR sys- 
tem to remain at the qualitative level. Consider, for instance, QSR 
constraint-based, RCC-8-like languages. Given the poverty conjec- 
ture, which corresponds to the fact that such a language can make 
only a finite number of distinctions, reflected by the number of its 
atomic relations, one way of answering the question could be to in- 
tegrate more than one QSR language within the same KR system. 
The knowledge at hand is then handled in a quantitative way only 
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in the extreme case when it can be represented by none of the QSR 
languages which the system integrates. 

One way for a KR system, such as described above, to reason about 
its knowledge is to start with reasoning about the qualitative part of 
the knowledge, which decomposes, say, into n components, one for 
each of the QSR languages the system integrates. For RCC-8-like 
languages, this can be done using a constraint propagation algo- 
rithm such as the one in pQ. If in either of the n components, an 
inconsistency has been detected, then the whole knowledge has been 
detected to be inconsistent without the need of going into low-level 
details. If no inconsistency has been detected at the high, qualitative 
level, then the whole knowledge needs translation into the unifying 
quantitative language, and be processed in a purely quantitative way. 
But even when the high-level, qualitative computations fail to detect 
any inconsistency, they still potentially help the task of the low-level, 
purely quantitative computations. The situation can be compared to 
standard search algorithms in CSPs, where a local-consistency pre- 
processing is applied to the whole knowledge to potentially reduce 
the search space, and eventually detect the knowledge inconsistency, 
before the actual search for a solution starts. 

With the above considerations in mind, we consider the integration 
of Frank's cone-shaped and projection-based calculi of cardinal di- 
rection relations JU]> well-known in QSR. A complete decision proce- 
dure for the projection-based calculus is known from Ligozat's work 
[17]. For the other calculus, based on a uniform 8-sector partition 
of the plane, making it more flexible and cognitively more plausi- 
ble, no such procedure is known. For each of the two calculi, the 
region of the plane associated with each of the atomic relations is 
convex, and given by the intersection of two half-planes. As a con- 
sequence, each such relation can be equivalently written as a con- 
junction of linear inequalities on variables consisting of the coordi- 
nates of the relation's arguments. We consider a more general, qual- 
itative/quantitative language, which, at the basic level, expresses 
convex constraints of the form r(x,y), where r is a cone-shaped or 
projection-based atomic relation of cardinal directions, or of the form 
(a, (3)(x,y), with a,/3 & [0,27r) and (j3 — a) G [0, 7r]: the meaning 
of (a, /3)(x,y), in particular, is that point x belongs to the (con- 
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vex) cone-shaped area rooted at y, and bounded by angles a and 
P. We refer to such constraints as basic constraints: qualitative ba- 
sic constraint in the first case, and quantitative basic constraint in 
the second. A conjunction of basic constraints can be solved by first 
applying constraint propagation, based on a composition operation 
to be defined, which is basically the spatial counterpart of compo- 
sition of two TCSP constraints jHj- If the propagation detects no 
inconsisteny then the knowledge is translated into a system of linear 
inequalities, and solved with the well-known Simplex algorithm. The 
preprocessing of the qualitative component of the knowledge can be 
done with a constraint propagation algorithm such as the one in pQ , 
and needs the composition tables of the cardinal direction calculi, 
which can be found in |lUj . 

To summarise, given combined qualitative /quantitative conjunctive 
knowledge, expressed as a conjunction of basic constraints, the rea- 
soning methodology we propose works in three steps: 

1. First apply (qualitative) constraint propagation pQ to each of the 
qualitative components of the knowledge. 

2. If no inconsistency has been detected by the previous step, then 
translate the qualitative knowledge into quantitative knowledge, 
so that the whole knowledge gets expressed in the unifying quan- 
titative language; then apply (quantitative) constraint propaga- 
tion to the whole, based on a composition operation to be defined 
later. 

3. If no inconsistency has been detected by the previous step, then 
translate the knowledge into a conjunction of linear inequalities, 
and apply the complete Simplex procedure to decide whether the 
knowledge is consistent. 

The general form of a constraint is (si V ■ ■ ■ V s n ) (x, y) , which we also 
represent as {si, . . . , s n }(x, y), where Si(x, y), for all i G {1, . . . , n}, 
is a basic constraint, either qualitative or quantitative. The meaning 
of such a general constraint is that, either of the n basic constraints 
is satisfied, i.e., Si(x, y) V • • • V s n (x, y). A general constraint is qual- 
itative if it is the disjunction of qualitative basic constraints of one 
type, cone-shaped or projection-based; it is quantitative otherwise. 
The language can be looked at as the spatial conterpart of Dechetr 
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et al.'s TCSPs [H]: the domain of a TCSP variable is IR, symbol- 
ising continuous time, whereas the domain of an SCSP variable is 
the cross product ExE, symbolising the continuous 2-dimensional 
space. 

The reasoning module of our KR system involves thus two known 
techniques: constraint propagation, based on composition of two ba- 
sic constraints, and the Simplex algorithm. If both basic constraints 
are qualitative, and both cone-shaped or both projection-based, then 
their composition is given by existing composition tables ^U]. Other- 
wise, the basic constraints are considered as quantitative, and their 
composition is computed in a way to be defined later (similar to 
composition of two convex TCSP constraints [S]). 

Some emphasis on our approach to knowledge representation is needed 
Researchers working on purely quantitative languages use arguments 
such as the poverty conjecture in [§] to criticise qualitative reason- 
ing in general, and QSR in particular. On the other hand , Q1R 2 re- 
searchers argue that quantitative reasoning goes often too much into 
unnecessary details, which is reflected by ideas such as "make only 
as many distinctions as necessary" borrowed to naive physics 
j!4j . Our approach is a conciliating one, and is meant to satisfy 
both tendencies. It consists of combining QIR languages known to 
be sufficient for a large number of applications, with a subsuming 
quantitative language. The number of QIR languages may be, as in 
the present work, more than just one, to allow potential applications 
high chances to remain at the high-level, qualitative languages for 
their knowledge representation. QIR researchers are satisfied since 
they have the possibility of using only the qualitative part of the 
language. On the other hand, if an application needs more expres- 
siveness than is allowed by any of the QIR sublanguages, then the 
unifying quantitative language is there to satisfy it. 

Current research shows clearly the importance of developing decid- 
able constraint-based spatial languages: specialising an ACC (V)-like 
Description Logic (DL) so that the roles are temporal immediate- 
successor (accessibility) relations, and the concrete domain is gen- 
erated by a decidable constraint-based spatial language, such as 

2 We use QIR and QnR as shorthands for Qualitative Reasoning and for Quantitative 
Reasoning, resepectively. 
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an RCC-8-like qualitative spatial RA [21], or a combined qualita- 
tive/quantitative language such as the one to be described in this 
paper, leads to a computationally well-behaving family of languages 
for spatial change in general, and for motion of spatial scenes in 
particular: 

1. Deciding satisfiability of an ACC{V) concept with respect to 
(w.r.t.) a cyclic TBox is, in general, undecidable (see, for instance, 

HE]). 

2. In the case of the spatio-temporalisation, however, if we use what 
is called weakly cyclic TBoxes in jTS], then satisfiability of a con- 
cept w.r.t. such a TBox is decidable. The axioms of a weakly 
cyclic TBox capture the properties of modal temporal operators. 
The reader is referred to for details. 

Spatio-temporal theories such as the ones defined in ^3] can be seen 
as single-ontology spatio-temporal theories, in the sense that the 
concrete domain represents only one type of spatial knowledge (e.g., 
RCC-8 relations if the concrete domain is generated by RCC-8). The 
calculus to be defined can, of course, generate such a single-ontology 
spatio-temporal theory; but with the disadvantage that the concrete 
domain would be heterogeneous, in the sense that it would group 
together two qualitative languages and a unifying quantitative lan- 
guage, which some applications might not find clean. We could, in- 
stead, use a 3-ontology spatio-temporal theory: two ontologies of the 
theory generated by the cone-shaped and the projection-based cal- 
culi of cardinal direction relations, the third ontology by the unifying 
quantitative language. 

2 Constraint satisfaction problems 

A constraint satisfaction problem (CSP) of order n consists of: 

1. a finite set of n variables, 

2. a set U (called the universe of the problem); and 

3. a set of constraints on values from U which may be assigned to 
the variables. 
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An m-ary constraint is of the form R{Xi x , ■ ■ ■ , Xi m ), and asserts that 
the values a^, . . . , a im assigned to the variables x ix , . . . , x im , respec- 
tively, are so that the m-tuple (a ix , . . . , a im ) belongs the m-ary rela- 
tion R (an m-ary relation over the universe U is any subset of U m ). 
An m-ary CSP is one of which the constraints are m-ary constraints. 
We will be concerned exclusively with binary CSPs. 

For any two binary relations R and S, R D S is the intersection of R 
and S, R U S is the union of R and S, R o S is the composition of R 
and S, and R~* is the converse of R; these are defined as follows: 



RnS = {(a,b) 
RUS = {(a,b) 
RoS ={(o,6) 
R~ ={(a,b) 



(a, b) G i? and (a, &) 6 S 1 }, 

(a, b) G -R or (a, 6) G 5}, 

for some c, (a, c) £ R and (c, 6) G S}, 

(6,a)ei2}. 



Three special binary relations over a universe U are the empty re- 
lation which contains no pairs at all, the identity relation X\j = 
{(a, a) : a G U}, and the universal relation = U x U. 

Composition and converse for binary relations were introduced by 
De Morgan |5l6j . 



2.1 Constraint matrices 

A binary constraint matrix of order n over U is an n x n-matrix, say 
B, of binary relations over U verifying the following: 

(Vz < n)(Ba C X^) (the diagonal property), 

(Vi,j < n)(Bij = (Bji)^) (the converse property). 

A binary CSP P of order n over a universe £/ can be associated with 
the following binary constraint matrix, denoted B p : 

1. Initialise all entries to the universal relation: (Vz, j < n)((B p )ij <— 
T b u) 

2. Initialise the diagonal elements to the identity relation: 

(Vz<n)((S p )u-X^) 

3. For all pairs (xi, Xj) of variables on which a constraint (xi, Xj) G R 

is specified: {B p ) tJ (B p ) t] n i2, (i3 p ) Jt ((i3 p )^)^. 

We make the assumption that, unless explicitly specified otherwise, 
a CSP is given as a constraint matrix. 
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2.2 Strong fc-consistency, refinement 

Let P be a CSP of order n, V its set of variables and U its uni- 
verse. An instantiation of P is any n-tuple (a 1; a 2 , . . . , a n ) of U n , 
representing an assignment of a value to each variable. A consistent 
instantiation is an instantiation [a±, 0,2, ■ ■ ■ , a n ) which is a solution: 
(Vi,j < n)((a,i, dj) G (B p )ij). P is consistent if it has at least one 
solution; it is inconsistent otherwise. The consistency problem of P 
is the problem of verifying whether P is consistent. 

Let V = {x^ , . . . , Xi .} be a subset of V . The sub-CSP of P generated 
by V , denoted P\y, is the CSP with V as the set of variables, and 
whose constraint matrix is obtained by projecting the constraint ma- 
trix of P onto V: (Vfc,Z < j)((B p \ v ') k i = (B p ) lkil ). P is ^-consistent 
|ll|12j (see also 0) if for any subset V of V containing k — 1 vari- 
ables, and for any variable X G V, every solution to P\y can be 
extended to a solution to P\vu{x}- P is strongly ^-consistent if it is 
j'-consistent, for all j < k. 

1-consistency, 2-consistency and 3-consistency correspond to node- 
consistency, arc-consistency and path-consistency, respectively |19|2Uj 
Strong n-consistency of P corresponds to what is called global con- 
sistency in 0. Global consistency facilitates the important task of 
searching for a solution, which can be done, when the property is 
met, without backtracking [T2"] . 

A refinement of P is a CSP P' with the same set of variables, and 
such that: (yi, 3 )((B p ') l3 <Z(B p ) l3 ). 

3 Frank's calculi of cardinal direction relations 

Frank's models of cardinal directions in 2D JU] are illustrated in 
Figure d They use a partition of the plane into regions determined 
by lines passing through a reference object, say S. Depending on the 
region a point P belongs to, we have No(P, S), NE(P, S), Ea(P, S), 
SE(P, S), So(P, S), SW(P, S), We(P, S), NW(P, S), or Eq(P, S), cor- 
responding, respectively, to the position of P relative to S being 
north, north-east, east, south-east, south, south-west, west, north-west, 
or equal. Each of the two models can thus be seen as a binary Relation 
Algebra (RA), with nine atoms. Both use a global horizontal/vertical, 
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Fig. 1. Frank's cone-shaped (left) and projection-based (right) mod- 
els of cardinal directions. 



left-right/bottom-up reference frame, which we suppose to be a Carte- 
sian coordinate system (O, x'x, y'y). The coordinate system so chosen 
clearly verifies the fact that, on the one hand, the x-axis x'x is paral- 
lel to, and has the same orientation as the West-East directed line of 
Frank's projection-based model, and, on the other hand, the y-axis 
y'y is parallel to, and has the same orientation as the South-North 
directed line of the same model — O is the intersection of the x- and 
y-axes. 

To differentiate between the two models, we use the underscore cs 
for the cone-shaped model, and the underscore pb for the projection- 
based model. Thus, from now on, (1) we refer to the cone-shaped 
model as CVA CS) and to the projection-based model as CVApb] and 
(2) we denote the atoms of CVA CS as No cs , NE CS) Ea CS) SE CS) So cs , 
SW CS , We cs , NW CS , and Eq cs , and the atoms of CVA p b as No p b, NE p b, 
Ea pb , SE pb , So pb , SW pb , We pb , NW pb , and Eq pb . 

A CD A cs (resp. CVApb) relation is any subset of the set of all CVA CS 
(resp. CVApb) atoms. A CVA CS (resp. CVApb) relation is said to be 
atomic if it contains one single atom (a singleton set); it is said to 
be the CVA CS (resp. CVA p b) universal relation if it contains all the 
CVA CS (resp. CVApb) atoms. When no confusion raises, we may omit 
the brackets in the representation of an atomic relation. 
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3.1 CSPs of cardinal direction relations on 2D points 

We define a CXU^-CSP (resp. CDA pb -CSP) as a CSP of which the 
constraints are CT>A CS (resp. CDApb) relations on pairs of the vari- 
ables. The universe of such a CSP is the set H 2 of 2D points. 

A CV A cs -ma.tnx (resp. CDApb- matrix) of order n is a binary con- 
straint matrix of order n of which the entries are CT>A CS (resp. 
CDApb) relations. The constraint matrix associated with a CDA CS - 
CSP (resp. CDApb-CSP) is a C£>.4. cs -matrix (resp. CXM P 6-matrix). 
A scenario of such a CSP is a refinement P' such that all entries of 
the constraint matrix of P' are atomic relations. A CSP of cardi- 
nal direction relations that does not include the empty constraint, 
which indicates a trivial inconsistency, is strongly 2-consistent. A 
CVA-CSP is a CSP which is either a CXU^-CSP or a CDA pb -CSP. 
An atomic CP.4-CSP is a CDA-CSP which is its own unique sce- 
nario (i.e., of which all entries of the constraint matrix are atomic 
relations). 

3.2 Solving a CDA-CSP 

A simple adaptation of Allen's constraint propagation algorithm pQ 
can be used to achieve path consistency (hence strong 3-consistency) 
for a CSP of cardinal direction relations, thanks to composition ta- 
bles of the calculi which can be found in [TUj . Applied to such a CSP, 
say P, such an adaptation would repeat the following steps until ei- 
ther stability is reached or the empty relation is detected (indicating 
inconsistency) : 

1. Consider a triple (Xj, Xj, X k ) of variables verifying (B p )ij % 
(B p ) ik o(B p ) kj 

2. (B p ) v - {B p ) l3 n (B p ) ik o (B p ) kj 

3. If {{B p )ij = 0) then exit (the CSP is inconsistent). 

Path consistency is complete for atomic CDA p b-CSPs ^7]. Given 
this, Ladkin and Reinefeld's solution search algorithm [TH] can be 
used to search for a solution, if any, or otherwise report inconsis- 
tency, of a general CDA p b-CSP. However, no such result is known 
for atomic CXM. c <,-CSPs. But even so, we still can apply the search 
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algorithm in JH] to search for a path-consistent scenario of a CDA CS - 
CSP, if such a refinement exists, or report inconsistency otherwise. 
The main result of the present work implies that we can solve the 
consistency problem of an atomic CT>A CS -CSP, by first translating 
it into a conjunction of linear inequalities on variables consisting of 
the coordinates of the point- variables of the CVA CS -CSP. This means 
that for a general CDA CS -CSP, we can use the search algorithm in 
[TB] augmented with the Simplex algorithm to decide its consistency 
problem. The basic idea is to apply the algorithm in ^H] as it is, 
and, whenever it succeeds to find a path-consistent scenario (the al- 
gorithm is then at the level of a leaf of the search tree), check, using 
the Simplex algorithm, whether that scenario is consistent, by trans- 
lating it into a conjunction of linear inequalities. If the conjunction 
of linear inequalities is consistent then the corresponding scenario 
is consistent, and is thus a consistent scenario of the input CT*A CS - 
CSP. If the conjunction is inconsistent, then the search for a possible 
consistent scenario has to continue. This is illustrated in Figure El 



Input: A CVAcs-CSP P; 

Output: true if and only if P is consistent; 

function consistent (P); 



1. PC(P); 

2. tf(P contains the empty relation) return false; 

3. else 

4. if(P contains edges labelled with relations other than atoms) { 

5. choose such an edge, say (Xi,Xj); 

6. R <— (3 p )ij\ % save before branching % 

7. for each atom r in R{ 

8. refine (S p ) i3 to r (i.e., (B p ) tj <- r); 

9. i/(consistent(P))return true; 

10. } 

11. {B P )ij *— R; % restore before backtracking % 

12. return false; 

13. } 

14. else{ % path-consistent scenario found: % 

% translate into linear inequalities and solve % 

15. translate P into a conjunction of linear inequalities, C; 

16. if(C has solutions) return true; 

17. else return false 

18. } 



Fig. 2. A consistent scenario search function for CVA cs -CSPs. 
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4 Temporal Constraint Satisfaction Problems 
— TCSPs 

TCSPs have been proposed in jH] as an extension of (discrete) CSPs 
|19|2U| to continuous variables. 

Definition 1 (TCSP [8J). A TCSP consists of (1) a finite num- 
ber of variables ranging over the universe of time points; and (2) 
Dechter, Meiri and Pearl's constraints (henceforth DMP constraints) 
on the variables. 

A DMP constraint is either unary or binary. A unary constraint has 
the form R(Y), and a binary constraint the form R(X, Y), where R is 
a subset of the set IR of real numbers, seen as a unary relation in the 
former case, and as a binary relation in the latter case, and X and 
Y are variables ranging over the universe of time points: the unary 
constraint R(Y) is interpreted as Y G R, and the binary constraint 
R(X, Y) as (Y — X) G R. A unary constraint R(Y) may be seen 
as a special binary constraint if we consider an origin of the World 
(time 0), represented, say, by a variable X : R(Y) is then equivalent 
to R(X ,Y). Unless explicitly stated otherwise, we assume, in the 
rest of the paper, that the constraints of a TCSP are all binary. 

Definition 2 (STP |8J). An STP (Simple Temporal Problem) is 
a TCSP of which all the constraints are convex, i.e., of the form 
R(X,Y), R being a convex subset of JR. 

The universal relation for TCSPs in general, and for STPs in partic- 
ular, is the relation consisting of the whole set 1R of real numbers: the 
knowledge (Y—X) G 1R, expressed by the DMP constraint K(X, Y), 
is equivalent to "no knowledge". The identity relation is the (convex) 
set reducing to the singleton {0}: the constraint {0}(X,Y) "forces" 
variables X and Y to be equal. 

5 A spatial counterpart of TCSPs: Spatial 
Constraint Satisfaction Problems (SCSPs) 

We now provide a spatial counterpart of TCSPs, which we refer to 
as SCSPs — Spatial Constraint Satisfaction Problems. The domain 
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of an SCSP variable is the cross product Ex E, which we look 
at as the set of points of the 2- dimensional space. As for a TCSP, 
an SCSP will have unary constraints and binary constraints, and 
unary constraints can be interpreted as special binary constraints 
by choosing an origin of the 2-dimensional space — space (0, 0). This 
will be explained shortly. 

Definition 3 (SCSP). An SCSP consists of (1) a finite number 
of variables ranging over the universe of points of the 2-dimensional 
space (henceforth 2D-points); and (2) SCSP constraints on the vari- 
ables. 

An SCSP constraint is either unary or binary, and either basic or 
disjunctive. A basic constraint is (1) of the form e(x,y), e being 
equality, (2) of the qualitative form (V) J (x,2/) or ( l r) J (x), depend- 
ing on whether it is binary or unary, r being a cone-shaped or 
projection-based atomic relation of cardinal directions other than 
equality, i,j 6 {0,1}, or (3) of the quantitative form ( l a, (3) J (x, y) 
(binary) or { l a, f3) 3 (x) (unary), with a, (3 G [0, 2tt), {(3 — a) G [0,7r], 
i, j G {0, 1}. (° and ( x stand, respectively, for the left open bracket ( 
and the left close bracket [. Similarly, )° and ) x stand, respectively, 
for the right open bracket ) and the right close bracket ] . A graphical 
illustration of a quantitative basic constraint is provided in Figure 

El 

5.1 Translating a qualitative basic constraint into a 
quantitative basic constraint 

A qualitative basic relation (V) J includes (resp. excludes) its lower 
bound, which is a half-line, if i — 1 (resp. i — 0); it includes (resp. 
excludes) its upper bound, which is also a half-line, if j — 1 (resp. 
j = 0). This means that the version of Frank's relations of cardinal 
directions we are using is such that, the region associated with an 
atom (see Figure may include both, one or none of its delimiting 
half-lines. 

We remind the reader that we have chosen our Cartesian system of 
coordinates, (O, x'x, y'y), in such a way that, on the one hand, the x- 
axis x'x is parallel to, and has the same orientation as the West-East 
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directed line of Frank's projection-based model, and, on the other 
hand, the y-axis y'y is parallel to, and has the same orientation as 
the South-North directed line of the same model. The x-axis x'x is 
the origin of angles, and the anticlockwise orientation is the positive 
orientation for angles. Given that we use the set [0, 2n) as the uni- 
verse of angles, if two angles a and (3 are so that a > )3, the interval 
( l a, (3) 3 will represent the union ( l a, 2n) U [0, (3) 3 . Furthermore, given 
any a, (3 G [0,2%), the difference (3 — a will measure the (angular) 
distance of (3 relative to a: the length, in radians, of the anticlockwise 
"walk" from a to (3 (this is, in other words, the size of anticlockwise 
sector determined by [a, f3]). 

The atom No cs , for instance, is bounded by the lines whose angular 
distances from the x-axis are for the lower bound, and for 
the upper bound (see FigureHfleft)). The qualitative basic constraint 
{ l No cs ) 3 (x, y) is thus equivalent to the quantitative basic constraint 
C^f") ^i~) 3 (. x > v)- The atom NE p b is associated with the region bounded 
by angles and ~: the constraint ( l NE p b) 3 (x, y) can thus equivalently 
be represented as the quantitative basic constraint ( l 0, | ) 3 (x, y). In a 
similar way, ('iVopi,)^!,?/) is equivalent to |) J (x, ?/). 3 The other 
qualitative basic constraints, either cone-shaped or projection-based, 
are translated in a similar way. The situation is summarised in the 
table below. 



CD A C s basic constraint 


Translation 


CVApt basic constraint 


Translation 


( l No cs y{x,y) 




CNo pb y(x,y) 




(>NE cs y(x,y) 


C!,ir} J (^y) 


CNE pb y(x,y) 


Co, </) 


( l Ea cs y(x,y) 


e¥,f> 3 (*,y) 


('Ea pb y(x,y) 


( l 0,0y(x,y) 


( l SE cs y(x,y) 




('SE pb y(x,y) 


C^,oy(x, y ) 


?So a y(x,y) 




(*So pb y(x,y) 


r^-,^y(x,y) 


CSW a y(x,y) 


C^^yi^v) 


('SW pb y(x,y) 




CWe cs y(x,y) 


C'^,f y{x,y) 


('We pb y(x,y) 


( l 7r, n) J (x, y) 


( l NW ca y(x,y) 


c^, 


('NW pb y(x,y) 


C|^} J (*,y) 



Thus we can, without loss of generality, suppose that a basic con- 
straint is of the form e(x, y), or of the quantitative form { l a, (3) 3 (x, y). 
A disjunctive constraint is of the form [Si V • • • V S n ](x, y) (binary) 
or [Si V • - • V S n ](x) (unary), with Sk(x,y) and Sk(x), k = 1 . . . n, 
being basic constraints as described above: in the binary case, the 

3 The reader should be convinced that the constraint (*?, ^) J (x,y) is consistent iff 
i = j = 1. A similar remark applies to the other qualitative basic constraints built 
from a 1-dimensional projection-based atom (Ea pb , We pb and So pb ). 
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meaning of such a disjunctive constraint is that, for some k — 1 . . . n, 
Sk{x,y) holds; similarly, in the unary case, the meaning is that, for 
some k = 1 . . .n, Sk(x) holds. A unary constraint R(x) may be seen 
as a special binary constraint if we consider an origin of the World 
(space (0,0)), represented, say, by a variable x : R(x) is then equiv- 
alent to R(x,xo). Unless explicitly stated otherwise, we assume, in 
the rest of the paper, that the constraints of an SCSP are all binary. 

An SCSP constraint, R(x,y), is convex if, given an instantiation 
y = a of y, the set of points x satisfying R(x, a) is a convex subset 
of the plane. A universal SCSP constraint is an SCSP constraint of 
the form [0, 27r)(x, y): the knowledge consisting of such a constraint is 
equivalent to "no knowledge", i.e., any instantiation (a, b) of the pair 
(x, y) satisfies it. A universal constraint is also a convex constraint. 
A convex SCSP is an SCSP of which all the constraints are convex. 
Given its similarity to an STP (Simple Temporal Problem) j^j, we 
refer to a convex SCSP as an SSP (Simple Spatial Problem). An 
SCSP is basic if, for all pairs (x, y) of variables, the SCSP includes 
a basic constraint of the form R(x, y) or R(y, x). We refer to a basic 
SCSP clS db BSP (Basic Spatial Problem). 

The standard path consistency procedure for binary CSPs is guided 
by three algebraic operations, the converse of a constraint, the com- 
position of two constraints, and the intersection of two constraints. 
These are defined below for SCSPs. 



5.2 The converse of an SCSP constraint 

The converse of an SCSP relation R is the SCSP relation R~" such 
that, for all x, y, R(x,y) iff R^(y,x). We refer to the constraint 
R^(y,x) as the converse of the constraint R(x,y). The converse 
of e(x,y) is clearly e(y, x). The converse of an SCSP quantitative 
basic relation ( l a, (3) J (x, y) is the SCSP quantitative basic relation 
( % a + Tc, /3 + ir) J (y, x), which can be explained by the simple fact that, 
given any instantiation (x, y) = (a, b) of the pair (x, y) satisfying the 
constraint ( l a, {3) J (x, y), the angle of the with the directed 

line (ba) is obtained by adding % to the angle of the x-axis with the 
directed line (ab). 
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y 

t 

D' 




y' 

Fig. 3. Graphical interpretation of the basic constraint ( l s, t) 3 (X, Y): 
Given Y, the set of points X satisfying the constraint ( l s, t) 3 (X, Y) is 
the cone-shaped area centred at Y, whose lower bound (open if % = 0, 
close otherwise) and upper bound (open if j = 0, close otherwise) are, 
respectively, the half-lines whose angular distances from the x-axis, 
with respect to anticlockwise orientation, are s and t. 
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5.3 The composition of two SCSP constraints 

The composition of two SCSP relations R and S, R o S, is the most 
specific relation T such that, for all x, y, z, if R(x, y) and S(y, z) 
then T(x,z). We refer to the constraint T(x,z) as the composition 
of the constraints R(x, y) and S(y, z). 

We describe how to compute the composition of two basic con- 
straints, from which derives the composition of two general SCSP 
constraints. 4 Clearly, e o R = R o e = R, for all SCSP relation R. For 
the general case, let R = ( n ai,fli) 31 and S = ( i2 ct 2 , ft)- 72 - The result 
here is that, if ft < a 2 < ft + tt and ft > ft + then R o S is the 
universal relation [0, 2tt), which means that, in such a case, given the 
knowledge R(x, y) and S(y, z), no knowledge can be inferred on the 
extreme variables x and z. Otherwise, R o S is obtainable in very 
much the same way as the composition of two (convex) intervals of 
the real line (cyclicity of the universe [0, 2tt) of angles is a bit te- 
dious but manageable). Basically, the result is { l a,P) 3 , where a is 
the minimum, in a certain sense, of a.\ and a 2 , /3 is the maximum 
of ft and ft, % is the logical AND of i x and i 2 , and j is the logical 
AND of ji and j 2 , and 1 being interpreted as FALSE and TRUE, 
respectively — left to the reader. 

5.4 The intersection of two SCSP constraints 

The intersection of two SCSP relations R and S, R(~)S, is the SCSP 
relation T such that, for all x, y, the conjunction R(x, y) A S(x, y) 
is equivalent to T(x,y). We refer to the constraint T(x,y) as the 
intersection of the constraints R(x,y) and S(x,y). Clearly, we have 
RD S = S H R (commutativity). 

We describe how to compute the intersection of two basic constraints, 
from which derives the intersection of two general SCSP constraints, 
e n e = e; e n ( l a,p) 3 = e if 1 = j = 1; and e D ( l a,(3y = 
if i = or j = 0. O^i, A)^ D f 2 a 2 ,/3 2 )^ = [a,, a,] U [ft, ft] if 
oji = ft = ft — 7r = «2 — 7r and Zi = ji = z 2 = J2 = 1; otherwise, 
( ll ai,Pi) n fl ( l2 a 2 , ft)- 72 is obtainable, again, in very much the same 

4 The reader should keep in mind that a quantitative basic constraint ( l a, P) 3 {x, y) is 
so that, the difference f3 — a belongs to [0, it]. 
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way as the intersection of two (convex) intervals of the real line — left 
to the reader. 

5.5 Translating an SCSP constraint into a conjunction of 
linear inequalities 

We now provide a translation of a quantitative basic constraint into 
(a conjunction of) linear inequalities. We will then be able to trans- 
late any SSP (thus, any BSP) into a conjunction of linear inequali- 
ties, and solve it with the well-known Simplex algorithm. Constraint 
propagation, based on the algebraic operations we have defined, and 
the Simplex can be combined in a solution search algorithm for gen- 
eral SCSPs: constraint propagation will be used at the internal nodes 
of the search space, as a filtering procedure, and the Simplex at the 
level of the leaves, as a completeness-guaranteeing procedure (the 
SCSP at the level of a leaf is a path-consistent SSP, but since we 
know nothing about completeness of path-consistency for SSPs, we 
need to translate into linear inequalities and solve with the Simplex). 

Given a point X of the plane, we denote by (xx, yx) its coordinates. 
The translation of e(X, Y) is obvious: Xx — Xy < A Xy — x x < 
A yx — Uy < A i/Y — yx < 0. For the translation of the quantitative 
basic constraint ( % a, (3) 3 {X, Y), we consider: the left half-plane (open 
if % = 0, close otherwise) delimited by the directed line through Y, 
whose angular distance from the x-axis is a; the right half-plane 
(open if j = 0, close otherwise) delimited by the directed line through 
Y, whose angular distance from the x-axis is /?; and the close right 
half-plane delimited by the directed line through Y, whose angular 
distance from the x-axis is a + 1 (see Figure|3]for details). We denote 
the three half-planes by lhp(Y, a, i), rhp(Y, j3,j) and crhp(Y, a + |), 
respectively. It is now easy to see that the constraint ( l a, (3) J (X, Y) 
is equivalent to X e lhp(Y,a,i) H rhp(Y, j3, j), if a ^ /3; and to 
X e lhp(Y, a, i) H rhp(Y, (3, j) n crhp(Y, a + f ), if a = f3. 

Thus, all we need is to show how to represent with a linear inequality 
each of the following assertions on two points X and Y of the plane: 

Al X lies within the open left half-plane delimited by the directed 
line through Y, whose angular distance from the x-axis is a. 



18 



A2 X lies within the close left half-plane delimited by the directed 
line through Y, whose angular distance from the x-axis is a. 

A3 X lies within the open right half-plane delimited by the directed 
line through Y, whose angular distance from the x-axis is a. 

A4 X lies within the close right half-plane delimited by the directed 
line through Y, whose angular distance from the x-axis is a. 

We refer to assertions Al, A2, A3 and A4 as I £ olhp(Y,a), X G 
clhp{Y,a), X G orhp(Y,a) and X G crhp(Y,a), respectively We 
refer to the line through Y, whose angular distance from the x-axis 
is a, as D. We consider eight cases: a = 0, < a < j, a = j, 
| < a < 7r, a = ir, ir < a < a = ^ < a < 2%. Since, for all 
a such that ir < a < 2tt (equivalent to < a — n < tt), we have 

1. X G olhp(Y, a) iff X G orhp(Y, a-n), 

2. X G clhp(Y, a) iff X E crhp(Y, a - tt), 

3. X G orhp(Y, a) iff X G olhp(Y, a — n), and 

4. X G crhp(Y, a) iff X £ clhp(Y, a — it). 

we can restrict the study to the first four cases, a = 0, < a < |, 
a — |, and | < a < 7T. The result is given by the table below, 
where, given an angle a, tga denotes the tangent of a. 





a = 


< a < | 


« = 5 


f < a <n 


X e olhp(Y, a) 


yx > VY 


yx - yy > tga.(x x - x Y ) 


yx < yy 


yx - VY > tg(ir - a).(x x - x Y ) 


X £ clhp(Y, a) 


yx > yy 


yx - yy > tga.{x x - x Y ) 


yx < yy 


yx - yy > tg{-K - a).(x x - x Y ) 


X e orhp(Y, a) 


yx < vy 


yx - yy < tga.(x x ~ x Y ) 


yx > yy 


yx - VY < tg(ir - a).(x x - x Y ) 


X e crhp(Y, a) 


yx < vy 


yx - yy < tga.{x x - x Y ) 


yx > yy 


yx - yy < tg{-K - a).{x x - x Y ) 



6 Summary 

We have provided a qualitative/quantitative constraint-based, TCSP- 
like language for reasoning about relative position of points of the 
2-dimensional space. The language, SCSPs (Spatial Constraint Sat- 
isfaction Problems), subsumes two existing qualitative calculi of re- 
lations of cardinal directions [10], and is particularly suited for ap- 
plications of large-scale high-level vision, such as, e.g., satellite-like 
surveillance of a geographic area. We have provided all the required 
tools for the implementation of the presented work; in particular, the 
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algebraic operations of converse, intersection and composition, which 
are needed by path consistency. An adaptation of a solution search 
algorithm, such as, e.g., the one in [TH] (see also jSJ), which would 
use path consistency as the filtering procedure during the search, can 
be used to search for a path consistent BSP refinement of an input 
SCSP. But, because we know nothing about completeness of path 
consistency for BSPs, even when a path consistent BSP refinement 
exists, this does not say anything about consistency of the original 
SCSP. To make the search complete for SCSPs, we have proposed 
to augment it with the Simplex algorithm, by translating, whenever 
a leaf of the search space is successfully reached, the corresponding 
path consistent BSP into a conjunction of linear inequalities, which 
can be solved with the well-known Simplex algorithm. 
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